## TEXT TO PHONEME TRANSLATION

### 2.1 Translation Files

There is a separate set of pronunciation files for each language, their names starting with the language name.

There are two separate methods for translating words into phonemes:

- Pronunciation Rules. These are an attempt to define the pronunciation rules for the language. The source file is:
  <language>_rules (eg. english_rules)
  and is compiled into
  <language>_1 (eg. english_1)

- Lookup Dictionary. A list of individual words and their pronunciations and/or various other properties. The source files are:
  <language>_list (eg. english_list) and optionally <language>_extra
  and are compiled into
  <language>_2 (eg. english_2)

### 2.2 Phoneme names

Each of the language's phonemes is represented by a mnemonic of 1, 2, 3, or 4 characters. Together with a number of utility codes (eg. stress marks and pauses), these are defined in the phoneme data file (see *spec not yet available*).

The utility 'phonemes' are:

' | primary stress
, | secondary stress
¬ | unstressed syllable
= | indicates stress on the preceding syllable
_ | short pause
; | a shorter pause
|| | indicates a word boundary within a phoneme string
| | can be used to separate two adjacent characters, to prevent them from being considered as a multi-character phoneme mnemonic

It is not necessary to specify the stress of every syllable. Stress markers are only needed in order to change the effect of the language's default stress rule.

The phonemes which are used to represent a language's sounds are based on the Kirschenbaum ascii character representation of the International Phonetic Alphabet www.kirschenbaum.net/IPA/ascii-ipa.pdf

### 2.3 Pronunciation Rules

The rules in the <language>_rules file specify the phonemes which are used to pronounce each letter, or sequence of letters. Some rules only apply when the letter or letters are preceded by, or followed by, other specified letters.

To find the pronunciation of a word, the rules are searched and any which match the letters at the in the word are given a score depending on how many letters are matched. The pronunciation from the best matching rule is chosen. The pointer into the source word is then advanced past those letters which have been matched and the process is repeated until all the letters of the word have been processed.

#### Rule Groups

The rules are organized in groups, each starting with a ".group" line:

.group <character>
  A group for each letter or character.

.group <2 characters>
  Optional groups for some common 2 letter combinations.

.group 9
  A group for numbers.

.group
  A group for other characters which don't have their own group.

When matching a word, firstly the 2-letter group for the two letters at the current position in the word (if such a group exists) is searched, and then the single-letter group. The highest scoring rule in either of those two groups is used.

#### Rules

Each rule is on separate line, and has the syntax:

[<pre>)] <match> [(<post>] <phoneme string>

eg.

    .group o
           o        0	// "o" is pronounced as [0]
           oo       u:      // but "oo" is pronounced as [u:]
        b) oo (k    U

"oo" is pronounced as [u:], but when also preceded by "b" and followed by "k", it is pronounced [U].

In the case of a single-letter group, the first character of <match> much be the group letter. In the case of a 2-letter group, the first two characters of <match> must be the group letters. The second and third rules above may be in either .group o or .group oo

Alphabetic characters in the <pre>, <match>, and <post> parts must be lower case, and matching is case-insensitive. Some upper case letters are used in <pre> and <post> with special meanings.

Special Characters in both <pre> and <post>:

_ | beginning or end of a word
A | any vowel
B | any hard consonant (not h,r,w)
C | any consonant
D | any digit
E F G | may indicate other sets of characters
Z | any non-alphabetic character
% | doubled (placed before a character in <pre> and after it in <post>
/ | following character is treated literally

The sets of letters indicated by A, B, C, E, F G may be defined differently for each language.

         _)  a         // "a" at the start of a word
             a (CC     // "a" followed by two consonants
             a (C%     // "a" followed by a double consonant (the same letter twice)
             a (/%     // "a" followed by a percent sign
         %C) a         // "a" preceded by a double consonants

Special characters only in <pre>:

@ | any syllable
& | a syllable which may be stressed (i.e. is not defined as unstressed)

eg.

         @@)  bi      // "bi" preceded by at least two syllables
         @@a) bi      // "bi" preceded by at least 2 syllables and following 'a'

Note, that matching characters in the <pre> part do not affect the syllable counting.

Special characters only in <post>:

@ | a vowel follows somewhere in the word
+ | force an increase in the score in this rule (may be repeated for more effect)
$<number> | this number of matching characters are a standard suffix, remove them and retranslate
P<number> | this number of matching characters are a standard prefix, remove them and retranslate
N | only use this rule if the word is not a retranslation after removing a suffix
£ | (English specific) change the next "e" into a special character "¬"

eg.

       @) ly (_$2   lI      // "ly", at end of a word with at least one other
                            //   syllable, is a suffix pronounced [lI].  Remove
                            //   it and retranslate the word.

       _) un (@P2   ¬Vn     // "un" at the start of a word is an unstressed
                            //   prefix pronounced [Vn]
       _) un (i     ju:     // ... except in words starting "uni"
       _) un (inP2  ,Vn     // ... but it is for words starting "unin"

$ and P must be at the end of the <post> string.

$<number> may be followed by additonal letters (eg. $2ei )

d | the previous letter may have been doubled when the suffix was added
e | "e" may have been removed
i | "y" may have been changed to "i"
v | the suffix means the verb form of pronunciation should be used
f | the suffix means the next word is likely to be a verb

### 2.4 Pronunciation Dictionary List

The <language>_list file contains a list of words whose pronunciations are given explicitly, rather than determined by the Pronunciation Rules. The <language>_extra file, if present, is also used and it's contents are taken as coming after those in <language>_list.

Also the list can be used to specify the stress pattern, or other properties, of a word.

If the Pronunciation rules are applied to a word and indicate a standard prefix or suffix, then the word is again looked up in Pronunciation Dictionary List after the prefix or suffix has been removed.

Line in the dictionary list have the form:

<word> [<phoneme string>] [<flags>]

eg.

         book      bUk

Rather than a full pronunciation, just the stress may be given, to change where it would be otherwise placed by the Pronunciation Rules:

         berlin       $2      // stress on second syllable
         absolutely   $3      // stress on third syllable
         for          $u      // an unstressed word

#### Multiple Words

A pronunciation may also be specified for a group of words, when these appear together. Up to four words may be given, enclosed in brackets. This may be used for change the pronunciation or stress pattern when these words occur together,

        (de jure)    deI||dZ'U@rI2   // note || used as a word break in the phoneme string

or to run them together, pronounced as a single word

        (of a)       @v@

or to give them a flag when they occur together

        (such as)    sVtS||a2z   $pause	   // precede with a pause

#### Flags

A word (or group of words) may be given one or more flags.

$pause | Ensure a short pause before this word (eg. for conjunctions such as "and")
$only | The rule does not apply if a prefix or suffix has already been removed.
$onlys | As $only, except that a standard plural ending is allowed
$strend | Word is fully stressed if it's at the end of a clause.
$strend2 | As $strend, but also stressed if followed by only unstressed word(s)
$unstressend | Word is unstressed if it's at the end of a clause
$atend | Use this pronunciation if it's at the end of a clause
$capital | Use this pronunciation if word has initial capital letter (eg. polish v Polish)
$dot | Ignore a . after this word even when followed by a capital letter (eg. Mr. Dr. )
$abbrev | Never speak this word as individual letters (eg, Roman numerals III, IV )
$verb | Use this pronunciation if it's a verb
$past | Use this pronunciation if it's past tense
$verbf | The following word is probably is a verb
$verbsf | The following word is probably is a if it has an "s" suffix
$nounf | The following word is probably not a verb
$pastf | The following word is probably past tense
$verbextend | Extend the influence of $verbf and $verbsf

The second group are probably English specific, but something similar may be useful in other languages. They are a crude attempt to improve the accuracy of pairs like ob'ject (verb) v 'object (noun) and read (present) v read (past).

The dictionary list is searched from bottom to top. The first match that satisfies any conditions is used (i.e. the one lowest down the list). So if we have:

        to    t@               // unstressed version
        to    tu:   $atend     // stressed version

then if "to" is at the end of the clause, we get [tu:], if not then we get [t@].